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Abstract 

In this paper, we investigate the existence and uniqueness of solutions 
for a class of evolutionary integral equations perturbed by a noise arising 
in the theory of heat conduction. As a motivation of our results, we study 
an optimal control problem when the control enters the system together 
with the noise. 
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1 Introduction 

Our main goal in this paper is to analyse a class of stochastic integro-differential 
equation arising in the theory of heat conduction for materials with memory and 
to present an application to an optimal control problem where the control enters 
the system together with the noise. Needless to say that many physical phe- 
nomena are better described if one considers in the equation of the model some 
terms which take into consideration the past hystory of the system. Further, it 
is sensible to assume that the modeld of certain phenomena from the real world 
are more realistic if some kind of uncertainity, for instance, some randomness 
or enviromental noise, is also considered in the formulation. 

We wish to mention that applications to optimal control problems naturally 
arise in the study of heating processes, for example in modeling heating with 
radiation boundary condition, simplified superconductivity, control of station- 
ary flows, glueing in polymeric materials (for a thorough introduction to these 
problems we refer to the standard monograph by Lions [16] or Fredi |23) . 
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Here we are concerned with the fohowing semihnear heat equation 

dtv{t,x) ^ koAv{t,x) + f ki{t - s)Av{s)ds + g{t,x,v{t,x)) (1) 

J —oo 

in the bounded domain C M"* with Dirichlet boundary condition 

v\gQ {t, x) = 0, teR,xedO (2) 

and initial condition given by 

v{s,x) — vo{s,x), s<0,xeO. (3) 

Notice that Vo{-) represents the past history of the system and should satisfy 
suitable smoothness properties (as we will see later on). Moreover, the function 
k{t) = ko + /q ki {s)ds is called the convolution kernel of the system and ki is 
assumed to be 3- monotone (see Hypothesis 12.11 for the precise definition of this 
term). 

We are interested in the analysis of the system ([1]) when the function g: 

i. is given by a Lipschitz continuous term / and an additive gaussian noise 
W with covariance Q, i.e. 

g{t, X, v) = fit, v{t, x)) + ^dtWit); 

a. depends on a further parameter 7 which introduces a control process in 
the system; this means that 

g = g{t, x, V, 7) = fit, v{t, x)) + ^/Q{r{t, v{t, x),j{t, x)) + dtW{t)), 

where r is a function with appropriate regularity. 

The main question arising around the first case (which we refer to as uncon- 
trolled problem) is to determine existence and uniqueness of the solution. This 
problem can be handled by reducing equation ^ to an abstract Cauchy problem 
on an appropriate product space, which contains the whole history of the solu- 
tion. Within this framework the system can be represented with the following 
evolutionary equation 

dX{t) ^ AX{t)dt + F{t, X{t))dt + VQdVF(i) 
X(0) = Xq, 

where A is the generator of a Co-semigroup, F is a Lipschitz continuous function 
Q a linear operator and W a vector defined in term of the Wiener process 
{W{t))t>o- Similar approaches are widely used in literature, see for example 
Miller [18] and Dafermos |IOj for the deterministic counterpart, Caraballo and 
Chueshov [3j |4] and the more recent work [2] for stochastic models. Anyway, 
differently for them, we are able to treat more general kernels k. 
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We stress that our approach may has the advantage that it naturally links 
the solution of a Volterra equation to a Markov process; this has the important 
development in view of the application of the analytic machinery to Volterra 
equations to solve the optimal control problems. 

In the case g contains a control parameter, the natural problem is to deter- 
mine a solution of the Volterra equation and a control process 7, within a set 
of admissible controls, in such a way that they minimize a cost functional. In 
particular in this paper we consider a cost of the form: 



where i and (j) are given real functions. 

In the same way as the uncontrolled problem, the model can be translated 
into an abstract setting. In particular, it can be rewritten in the form 



where A, F,Q,W,Xo are as above and R is given in terms of the function 
r. Notice here the special structure of the control term, which is clearly a 
restriction; however it arises from concrete models. Due to the special structure 
of the control term we are able to perform the synthesis of the optimal control, 
by solving in the weak sense the closed loop equation. Thus, we can characterize 
optimal controls by a feedback law. 

The paper is organized as follows: in the next subsection we give the physical 
motivation of our work; in Section [5] we introduce the main assumptions on the 
coefficients of the problem while in Section [3] we reformulate the uncontrolled 
problem into a semilinear abstract evolution equation and we study the proper- 
ties of leading operator, while in Section |4] we are concerned with the stochastic 
convolution of the rewritten equation. To this end, we study the so-called resol- 
vent family (see Subsection 14. ip and the scalar resolvent family (see Subsection 
14. 2p associated with our problem. In Section [5] we prove the first main result 
of the paper: we determine existence and uniqueness of the solution of the un- 
controlled Volterra equation [TJ Finally, in Section [6] we perform the standard 
synthesis of the optimal control. 

1.1 Motivation 

Let us briefiy explain one possible physical meaning of our model. Let be a 
3-dimensional homogeneous and isotropic rigid body (see Priiss [21' p. 125] for 
more details on the physical terminology) which is represented by an open set 
C M'' [d ^ 1,2,3) with boundary dO of class C^. Points in (i.e. material 
points) will be denoted by x,y,.... Suppose that the body is subject to 
temperature changes. We denote hy v — v{t, x) the temperature at time t G M"*", 
q{t,x) the heat flux vector field, e(t,x) the temperatue and f{t,x,v) the heat 
supply (possibly depending on the solution itself). 




e{t, v{t, 0,l{t, C)de dt + E I cb{v{T, C))de, 




( 



dX(t) = AX{t)dt + F(i, X{t))dt + VQ{R{t, X{t),j{t))dt + dW{t)) 
XiO) = Xo, 
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We denote hy v — v{t,x) the temperature at time t e IR+, q{t,x) the heat 
flux vector field, e{t,x) the temperatue and f(t,x) the external heat supply. 
Balance of energy then reads as: 

dte{t,x) = -divq{t,x) + f{t,x), teR,xeO, (4) 

with the boundary conditions basically either prescribed temperature or pre- 
scribed heat flux through the boundary. In particular, one (natural) choice is 
represented by Dirichlet boundary conditions: 

v{t,x)\x^oo ==0, t eR. 

For the relationship between e and v we shall use the following linear law (or, 
more formally, constitutive law): 

e{t,x)= i dm(r)u(i - r,x)dr + Coo, teM+,xeO; 
Jo 

where too is a suitable positive phenomenological constant. Analogously, for the 
constitutive law relating q and v we choose 

/•OO 

q{t,x)^~ dk{r)Wv{t - r,x), teE.,xeO, 
Jo 

where m,k ^ i3V/oc(K^) are scalar functions. 

Rearranging equation we arrive at the following non autonomous heat- 
equation with memory 

dm * dtv{t, x) ^dk'f Av{t, x) + f{t, x), t>Q,xe 0; 
v{t,x) = Q, ieM+,a;eaO, 

where * denotes the symbol for the convolution product between two functions. 

Remark 1.1. From the literature one can infer that m is a creep function, 
i.e. it is nonncgativc, nondecreasing and concave which is also bounded. The 
natural form of this kind of functions is given by 

m{t) = mo + moot + / mi(r)dr, 
Jo 

for Too > 0, TOoo > (in our case, TOqq = 0) and toi e L^(M+). 

From a physical point of view, toq corresponds to the istantaneous heat 
capacity, i.e. the ratio of the change in heat energy of a unit mass of a substance 
to the change in temperature of the substance. The function toi is called energy- 
temperature relaxation function while to(oo) = toq + /g TOi(s)ds is termed 
equilibrium heat capacity. In accordance with several works concerning with 
same type of problems (see, for example, Clement and Nohel J^, Nunziato(20|. 
Monnieaux and Priiss [19], Grasselli and Pata [l3l[T4]), in this paper we choose 
for semplicity m[t) = toq = 1. 
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Concerning the function k, the hterature is somewhat controversial. From 
Gurtin and Pipkin |15| and Nunziato |20| one can expext that fc is a bounded 
creep function as well, in particular koo = 0, fci e L^(]R+) and fc(oo) = 
ko + fci(s)ds > 0. The constant kg is termed istantaneous conductivity, 
fc((X)) is called equilibrium conductivity while ki is called heat conduction relax- 
ation function. On the other hand, Clement and Nohel [7] , Clement and Priiss 
[S] and Lunardi [T7] and write k{t) = ko — ki{s)ds > with fci positive and 
nonincreasing; in this case k is 2-monotone (see Hypothesis 12.11 for the expla- 
nation of this term). Also Bonaccorsi and Da Prato and Tubaro [2] consider 
k as above but they require fci completely monotone. In this theory the equi- 
librium conductivity fc(cxi) = ~ /g ki{s)ds is smaller then the istantaneous 
conductivity, in contrast with Nunziato. 

We stress that in the present paper, we assume that k has the same form as 
in Gurtin and Pipkin T5I and Nunziato |20) . 

2 General assumptions 

In equation ([T]), we are given the kernel k : K — > K, the non linear term 
/ : R — M and the stochastic perturbation {W{t))t>o- 
We assume the following. 

Hypothesis 2.1. The kernel {k{t) : t > 0} is a creep function, that is, k{t) := 
fco -l- /q ki(s)ds, where fep > and the function ki is 3-monotone, that is, it 
satisfies the following conditions: 

hi) kiE L^{R+)nC^{R+); 

h2) ki is positive and nonincreasing; 

hS) —k[ is nonincreasing and convex; 

Remark 2.2. We stress that the above assumption allows ki{t) to have a 
singularity at t — 0, whose order is less than 1, since k{t) is a non-negative 
function in L^(M+). For instance, we are able to consider a weakly singular 
kernel of the following type 

hit):^^, 0<7<1. 

Remark 2.3. Following the terminology introduced by Priiss [2TJ Definition 
4.4 pag. 94], the function k belongs to the class of creep functions. As stated in 
Section [1] the function k has a physical meaning within the theory of materials 
with memory. 

Concerning the nonlinear part of the system we have: 

Hypothesis 2.4. The function f : [0,T] x R M satisfies the following 
conditions: 
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1. f is continuous and dijferentiable on M. 

2. f is Lipschitz continuous with respect to x, uniformly on t, and has sub- 
linear growth; this means that there exists a constant L > such that 

\f{t,x)\ < L{l + \x\) t>0,xeR 

\f{t, x) - fit, y)\ < L\x -y\ t>0,x,yeR. 

The conditions on the stochastic perturbation are given in the fohowing. 
Hypothesis 2.5. 

1. The process {W{t))t>Q is a cylindrical Wiener process defined on a com- 
plete probability space with values in L^{0). In particular W{t) is of the 
form 

oo 

{W{t),x) = ^(efc, x)l3k{t), t>0,xe L'(0) 

fc=0 

where {Pk}keN sequence of real, standard, independent Brownian mo- 
tions on {n,3', (Jt)t>o,P). 

2. Q is a linear bounded operator, symmetric and positive. With no loss of 
generality, we shall assume in the sequel that A and Q diagonalizes on the 
same basis of L^{0) (this is required only for semplicity); 

3. If and {Ajj^^pj are respectively the eigenvalues of A and Q then 
we require 

where S is the quantity 

(S:=l + -sup{|argfc(A)| ;ReA>0} (5) 

TT 

and 6 is any real number in (0, 1) such that 1 + 6 > 6. 
Remark 2.6. 

i. We notice that the quantity S introduced in ([5]) depends only on the be- 
haviour of the Laplace transform of the kernel k. In Pruss and Monnieaux 
[TOj it is proved that, for the class of kernels considered by us (i.e. for 3- 
monotone kernels), the Laplace transform k satisfies the following bound: 

sup{|argfc(A)| : ReA > 0} = 61 < I (6) 
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and, consequently, S belongs to (1, 2). Following the terminology in Priiss 
(see [21]) we say that the kernel k is ^-sectorial. 

It can be proved that the sectoriality of the kernel plays a central role 
in the study of the Volterra equation [T] In particular, it allows to prove 
existence of the resolvent family corresponding with the problem, and 
consequently to investigate existence and uniqueness of the solution. For 
more details we refer to Section |4T1 and the monograph [211 Section 3]. 

ii. As has been observed, 5 G (1, 2); then conditionOin Hypothesis 12 . 5 1 implies 
that Tr[(5A~'^] for any e G [0,2/5 — 1). We stress that this condition is 
authomatically satisfied if Q is of trace class. 

3 Statement and Reformulation of the uncon- 
trolled equation 

3.1 The abstract setting 

In this section we are concerned with the following (uncontrolled) class of inte- 
gral Volterra equations perturbed by an additive Wiener noise 



Our first purpose is to rewrite equation ([7]) as an evolution equation defined on 
a suitable Hilbert space. 

To this end we denote with L^{0) the space of square integrable, real valued 
functions defined on with scalar product (w, v) = Jg w(^)w(^)(i^, for any u,v € 
L^(0). Sobolev spaces iJ^(O) and H^{0) are the spaces of functions whose first 
(resp. first and second) derivative are in L^(0). We set moreover Hq{0) the 
subspace of H^{0) of functions which vanish (a.e.) on the boundary dO. 

We let X = H-^{0) the topological dual of H^{0). 

We recall that the operator A with domain Hq{0) is the generator of a Co- 
semigroup of contractions; since A is self adjoint, the semigroup is analytic: see 
for instance [Ml 22, Theorem 1.5.7, Corollary 1.5.8]. 

In order to control the unbounded delay interval, we shall consider weighted 
spaces. Let 



Then we set X = Ll{R+; H^{0)) be the space of functions y : M+ ^ D{A) = 




t > 



(7) 



v{—t,x)—vo{—t,x), t>0 
v{t,x)=0, t>0,xedO. 




(8) 
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Hq{0) endowed with the inner product 

/•oo 

(2/i,2/2)x=/ p(s)(V?/i(s), V2/2(s))ds 



and ||y||x the corresponding norm. On this space, we introduce the delay oper- 
ator K with domain D{K) = X by setting 

/>oo 

Krj — I ki{s)Arj{s)ds 
Jo 

Finally, we define the Hilbert space 5{ = L^{0) x Ll{R+; H^iO)) endowed with 

the energy norm = l|w|li2(o) + WvWh ^= 0- 

Our aim is to reduce this problem to an abstract Cauchy problem on the 
product space Jf in such a way that the first component gives the evolution of 
the system while the second contains all the informations concerning the whole 
history of the solution. The state variable in the Hilbert space !H will be denoted 
by X{t). Thus {X{t))t>o is a process in !H and the initial condition is assumed 
to belong to ?{ and satisfies suitable properties to be precised. 

We introduce the linear operator A defined as: 



A 



v\ _ (A K \ (v 

^ fkoAv + ki{s)A7j{s)ds 

with domain D{A) C Jf 
D{A) :-{(^(.)) eH^{0)xWl^'{R+;H^{0}) : v{0)^v, Av + KrjeT 

In order to handle the contribution of temperature values taken in the past, 
we introduce the new variable 

r)\s) ^ v{t - s), s>0. 

Moreover, we introduce the non linear operator F : [0, T] x IK — > 5{ 



F t 



where / is the non linear term in Equation [71 Finally we introduce the linear 
operator Q and the stochastic perturbation W on J{ as 

With the above notation, problem ((T]) can be rewritten in the form 
Ux{t) = {AX{t)+F{X{t)))dt + ^dW{t), te[0,T], 

\x{0) = Xo e K, ^ ' 
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where X{t) stands for the pair (^i*.'')) and Xq :~ (j,")) initial condition. 

In the following (see Section [32]) we will see that the dynamics of the system 
is described in terms of the transition semigroup e^'^ generated by the linear 
operator A. As a consequence we will read the solution of the original Volterra 
equation in the first component of X. 

Before prooceding, let us recall the definition of mild solution for the stochas- 
tic Cauchy problem 

Definition 3.1. Given an 3^(-adapted cylindrical Wiener process on a proba- 
bility space {ft, 3^, (IFt)t>o, P), a process {X{t))t>Q is a mild solution of © if it 
belongs to i^(0, T; ?{)) and satisfies P-a.s. the following integral equation 

X{t) = e*^Ao + /* e(*"^)^F(A(s))ds + f e(*-^)^yQdW^(s), t > 0. 
Jo Jo 

(10) 

Condition [10] implies that the integrals on the right-member are well defined. 
In particular, the second integral, which we shall refer to as stochastic convolu- 
tion, is a mean- square continuous gaussian process with values in !K. For the 
analysis of the stochastic convolution and its properties, we refer Section [3] 

3.2 Generation properties 

In this section we are dealing with the generation properties of the leading (ma- 
trix) operator and prove that, in our setting, the operator is quasi-m-dissipative 
(see inequality ([TT]) below) and that the range of /i — A is dense in 5{ for some 
(and all) fj, > 0. In this way we will able to apply the Lumer-Phillips theorem 
to conclude that A — fi, and hence A, generates a Co-semigroup. 
We start by proving the dissipativity properties. 

Theorem 3.2. The operator (A,£'(A)) is quasi-m-dissipative: for any (j) = 
{u,r]) G D(A) there exists Ao > such that, for any A > Aq 

(A0,0) < A||0||jc. (11) 

Proof. We proceed in the same spirit as Bonaccorsi and Da Prato and Tubaro 
[21 Theorem 3.1], but we include the proof for completeness. The difference, 
here, is that we have no conditions linking the constant fco and the function fci . 
In contrast with [2 , this point doesn't allow to prove the pure dissipativity of 
A, but only quasi-m-dissipativity. 
We compute the scalar product 

{A(j),4>) = fco(A^u,w)i2(o) 

+ / fci(r)(M, A^r7(r))i2(o)dr - / p(r)(VT/(r), V?7'(r))i2(o)dr 

JM.+ JR+ 
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and we get 



< -fcolla;|l^i(0) + [ fciWlla;|lffi(0)lb/WllHoMo)d»-- |pWh('')llHi(o) 



4-00 



Now recall that p > while p' ~ —ki < 0; choose some e > and use the bound 
a6 - i(l - e)b'^ < 2(T^a^ with a ^ ||a;||^i(o) and b = ||?7WIIh1(o) to get 



for any A > Aq := min |o, — fcp + ^i^e^ p(0)|- D 

Next, we consider the properties of the resolvent A). 
Theorem 3.3. For every /i > the equation 

(Ai-A)(/. = ^, ^eM, (12) 
has a unique solution cj) G D{A). 

Proof. We give only a sketch of the proof, since it essentially repeats the argu- 
ments of Bonaccorsi & Da Prato & Tubaro 2, Proposition 3.2]. Let (f> — ('J) 

and ip = (|) . Then equation (fT2|) is equivalent to 

/iu — kgA^u — Krj = V 
mis) - Tijis) = £_{s). 

From the variation of constant formula we get 



moreover, using the monotonicity property of p it is possible to prove that 
r] e Wp'^(M+; iJg (0)). Straightforward calculation, gives 



where Ck,fj, is a positive constant depending only on k and /i while v is the 
function 

r+oo i<s 

v:^v+ fci(r)A^ / e-''^'^'''^r]{r)ds dr. 
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Obviously u G D(A^). Finally, we notice that 

koA^u + Kf] = fiu-v e ^2(0); 
hence, it turns out that = (") e D{A). 



□ 



Taking into account the above results, we can deduce the generation prop- 
erties for the operator A. Precisely, we have 

Proposition 3.4. Under Hvvothesis \2.1{ \2.4\ and \2.5\ the operator (A, £>(A)) 
generates a strongly continuous semigroup. 

Proof. The result follows by a direct application of a perturbation method and 
the Lumer-Phillips Theorem. □ 

4 The stochastic convolution 

The main object of investigation of this section is the stochastic convolution 
corresponding with our problem, that is the process 



In particular, our purpose is to prove that (MOi(i))t>o is a well-defined mean- 
square continuous gaussian process with values in 'K. Following the approach 
of Da Prato and Clement [5], Bonaccorsi and Da Prato and Tubaro [2], we 
can give a meaning to the stochastic convolution through the study of the so- 
called resolvent family associated with an abstract homogeneous linear Volterra 
equation of type 



where A: is a kernel satsfying Hvpothesis 12.11 and where denotes the Laplace 
operator on with Dirichlet boundary conditions. The concept of the resolvent 
plays a central role for the theory of linear Volterra equations and can be applied 
to inhomogeneous problem to derive a variation of parameters formula. The 
main tools for the resolvent are described in detail in the monograph [21 . In 
the next subsection we recall a few basic concepts and results. 

4.1 The resolvent family 

Following [211 Section 1], we define the resolvent family for the equation (fTS]) as 

Definition 4.1. A family {S{t))t>o of bounded linear operators in X is called 
a resolvent for equation (fTS]) if the following conditions are satisfied: 

(SI) 5(0) — I and, for all x e X, t y-^ S(t)x is continuous on IR+; 




t > 0. 



V 



{t)^k*A 



v{t) 



(13) 
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(52) S{t) commutes with A^, that is for a.e. t > 0, S{t)D{A^) C I?(A^) and 

A"S{t)v = Sit)A^v, veD{A^); 

(53) for any v G D{A°), t ^ S{t)v is a strong solution of © on [0, T], for any 
T > 0. 

It turns out that if the kernel k satisfies Hypothesis 12 . 1 1 ( or . more generally, if 
it is ^-sectorial for 9 < vr), then equation admits a resolvent {S{t))t>o which 
is uniformly bounded in L^(0) (see [HI Corollary 3.3]). Consequently (see pTl 
Proposition 1.1]), problem (IT5|) is well-posed and its strong solution is given by 
the function v{t) = S{t)v. Besides, since k{t) belongs to BVzoc(R+), S{t) turns 
out to be differentiable and consequently (by differentiation of equation ([13])) 
the function v is the mild solution of the homogeneous Cauchy problem 

i v'{t) = dk^A^vit) 

Here the term dfc * A^v{t) denotes the function 

fcoA^w(s)(5o(s) + / ki{t~ s)A^v{s)ds. 



Analogously, it can be proved that if g is a function belonging to L^{0,T; X), 
then the Cauchy problem 

i v' = dk*A°v + g 

\v{Q)^v&Hl{0) ^ ^ 

is well-posed too and its (unique) mild solution can be represented through the 
variation of parameter formula as 

v{t) ^ S{t)v + [ S{t- T)g{T)dT, t > 0. 
Jo 

For a full discussion about the notion of well-posedness for equation ([T^ . of 
mild solution for problems of type , ([T5|) and their relationship between the 
resolvent family we refer to PT, Section 1]. 

Here we want to emphasize that the above arguments can be applied to the 
inhomogeneous Volterra equation (O to obtain existence and uniqueness of a 
mild solution and its representation in terms of the resolvent family correspond- 
ing with the kernel fc = 1 * dfc. In fact, equation ([7]) is equivalent to 

Vt{t,x) = koAv{t,x) + / ki{s)Av{s, x)ds 

.oo (16) 

+ / k{s)Av{t - s,x)ds; t > 0, 
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with boundary and initial conditions given by: 

v{—t,x)=vo{—t,x), t>0, 
v{t,x)^0, t>0,xedO. 

In abstract form, we have 



v'{t) ^dk*A^v{t)+ J k{s)A^vo{t- s)ds, t>0 
«(0)=«o(0)ei?o'(0)- 

Therefore, integrating ([T6| over [0, t] we obtain 

v{t)^VQ{0)+[ {dk*Av){s)+ [ ds( [ k{s + r)Avoi~r)dr] . (17) 



Now, by the associativity property of the convolution product, the second term 
in the right member of (jl7|) gives 

/ dfc * Av{s, x) — I * (dfc * Aw) = (1 * dfc) * Aw 

= fc * Av = / k{s)Av{t — s)ds. 
Jo 

Hence equation ([7]) can be rewritten as follows: 

v{t)^VQ{0)+[ k{t- s)Av{s)ds + h{t) (18) 

where the function h is given by 

h{t) ^ f dsl I k{s + r)Avo{r)dr 
Jo \Jo J 

Now the variation of parameters formula implies that the function 

v{t)^S{t)vo{0)+ f S{t~- s)h{s)ds 







is a mild solution of the Volterra equation p^ . provided that h e L^{0, T; X). 
We notice that the condition vq e Ll{R+;H^{0)) assures the requested regu- 
larity for the function h. 

4.2 The scalar resolvent family 

Suppose that (5(t))t>o is the resolvent family for equation and let {^j}^^^^ 
be the set of eigenvalues of A^ with respect to the basis {ej}j^ bN- For any 
j S N, we introduce the following one-dimensional Volterra equation 



s 



j{t)+fij{k*s,){t) = l. (19) 
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Then (see [^TJ Section 1.3]) a unique solution to (|19l) exists and it satisfies 

S{t)ej ^ Sj{t)ej, t>0. 

In particular, the resolvent family S{t) admits a decomposition in the basis {cj} 
of L^{0) in terms of the solutions Sj to ([T5|. 

In the sequel we state and prove some useful estimates on the scalar resolvent 
functions Sj . They are crucial to study the stochastic convolution and descend 
immediately from the assumption on the kernel k. 



Lemma 4.2. Let k satisfy Hvvothesis \2.1\ Then, for any j G N, equation (|19p 
admits a solution Sj(t) such that the following properties hold: 

1. \sj{t)\ < M for all t > 0; 

2. J,°^\s'^it)\dt<C; 

3. /„°°t|.;.(t)|dt<C7/i7S- 

4- Jf^°° \sj{t)\dt < C/iJ^. where M and C denotes suitable positive con- 
stants. 

Proof. Assertion [T] follows from [3TJ Corollary 3.3], while assertions and [3] 
are contained in Monnieaux and Pruss [19[ Proposition 6] (observe the relation 
s'j{t) = —fj,jrj{t) to connect the notations). To proved we notice that 



s,{t) ^ s,{R) - 4(r)dr. 



Hence assertion [5] implies that the limit of Sj{R) for R ^ oo exists; moreover, 
we have 

lim s,(i?) = sj(0)+ lim / 4(T)dr = l+/ 4(r)dT. 
We observe that the last term in the above equality can be rewritten as 

/•oo 

lim / e~^''s'(T)dr = lim s.Me^^^C + lim As,-(A) 



= - 1 + lim As,- (A). 



Further, since sj satisfies equation ([19]), we get 



^^^(^^ = \ ^TTT = T^^^TTTT' ^^^^ 

X + fijk{X) X^ + ko + ki(X) 



in fact, we have 

Sj(A) +/ijfc(A)sj(A) ^ -, 
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and 



A A ■ 

We notice that, since fci belongs to L^(M+), for any A > it holds 



\ki{X)\ 



rOO rOO 

/ e-^*ki{t)dt < / ki{t)dt<oo. 
Jo Jo 



Taking into account the last inequality and equality (j20p we see that the limit 
of Sj (R) for i? — >■ oo satisfies 

lim Sj(R) = lim — 0. 

R^oo A^0+ A2 + fco + fcl(A) 

Therefore 

/oo 
4(r)dT 

yields 

/ \sj{T)\dT< / \s'^{r)\drdt^ r|4(r)|dr<CM-^/^ 
Jo Jo Jt Jo 

by assertion [3] □ 

For further use, we conclude this subsection with an estimate concerning the 
norm of Sj in L2(R+). 

Lemma 4.3. Suppose that the kernel k is subject to Huvothesis \2.1[ Then for 
each G (0, 1) and for any T > 0,, there exists a constant Cq^t > (depending 
only on 9 and T) such that 



-{e+i)/5 

"J 



I dT [ s]{o)do <Ce,Tli] 
Jo Jq 

Proof. From assertion [T] of Lemma 14.21 we obtain 

-1/5 



as well as 



/ Sj(o-) da<M / \sj{a)\da < Mfi 
Jo Jo 



hence employing Lemma 14.21 - 2] 



^ s|(a)da < Af-2e^-e (^J^ \sj{a)\d<j^ < Cefi 



{i+e)/s e 

3 



Now integrating both members of the previous inequality we obtain the thesis. 

□ 
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4.3 The representation of the semigroup 

In the following we show that the semigroup corresponding with the hnear op- 
erator e*"^ can be computed expUcitly in terms of the resolvent family {S{t))t^Q. 

We recall that since the linear operator A generates a Co-semigroup, there 
exists a unique mild solution (X(t))(>o for the deterministic equation 

X'{t) = AX(t), 

The variation of parameter formula for abstract evolution equations applies to 
equation (|2ip and we can write: 



X{t) - e*^Xo. 

If we set 



e 



tA ( (^11 (il2 

tA tA ] > 
C21 



then, for any t > 0, we have 

v{t)^el^it)v + el^m, 
v\-)^e',^it)v + el^m 

By construction, the first component of X satisfies the inhomegenous Volterra 
equation 



v{t)=VQ{0) + J k{t- s)Av{s)ds + J ds k{s + r)Avoi-r)dr j (23) 

and the variation of parameters formula for Volterra equations applied to (|23p 
(see Subsection l4.ip yields 

v{t)^S{t)v+ f S{t~T)h{T)dT 

(24) 

^ / «(t - 5) = Sit - S)V + J* ' S{t - S - T)hiT)dT, 0<S<t 



where 



ri{t — s), s > t, 

h{t)= / k{t + a)Avo{-c7)dc7 

= / k{t + a)Afj{a)da. 

Jr+ 
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Comparing the first terms in equalities (1^^ and (1^^ . we obtain 

e\^v = S{t)v e{^fj^ f S{t-T)h{T)dT. (25) 

Moreover, from the second part of ((22|) and ((24| . we have for s > 

ielfv)is)^S{t^s)vl[o,t]is) 

Jj^' S{t-s-T)fyiT)dT, 0<s<t (26) 
f]{t — s), s > t. 

Thus the semigroup e*^ is completely described in terms of the resolvent family. 
As we will see in the next subsection, the above characterization allows to study 
the stochastic convolution process. 

4.4 The stochastic convolution 

We are now in the position to prove the main result of this section. We recall 
that {W{t))t>o is a cylindrical Wiener process of the form 

oo 
k=0 

where {/3fc};.gpf is a sequence of real, standard, independent Brownian motions 
on (rj, J,(?t)t>o,P). We have: 

Lemma 4.4. Under Hvvothesis \ 2.5[ for all T > the process {WA{t))o<t<T 
defined as 

WA(t) /*e(*-^)^dW(s), (27) 
Jo 

is a gaussian random variable with mean and covariance operator 

Q, :^ [ e'^Qe'^'ds. 
Jo 

Proof. It is well-known that the thesis follows provided that 

Jo 

where Ct is a positive constant depending only on T > 0. Recalling the repre- 



17 



sentation of e*'^ given in (pS)) and (|26p . we have that 









'0 







dr 



E 



'5'(T)\A7ej 



•K 



(28) 



'^illL2(o)d7- 



/ / (5(CT)||5(r-CT)ej||L(oa[o,^]dCTdr. 

We consider separately the two series in the previous formula. We recall that 
S{t)ej = Sj{t) for any j € N (see Subsection l4.2p : hence we get 

oo „f oo „t oo „i 

E^W II^We^Hi^(0)dr-EA, / |,s,(T)pdr<^A, / |s,(r)|dr, 
j=i Jo ^0 ^-^1 Jo 

where the last inequality follows from Lemma 14.21 point [TJ Moreover, since it 
holds also that /q°° |sj(T)|dT < {^jko)^^ (see Lemma point H]), it follows 
that 



oo „t 

E^^- / ii^w 

„_i Jo 



ejlll2(o)dT< — ^— . 



Concerning the second series in (l28l) . applying Fubini's theorem, we get 
^A,A^, / / 5(a)|s,(r-a)|2dadr<^A,^W da6{a) dr\s,{T - a)\' 

Jo Jo . ]^ Jo J(T 



and, taking into account Lemma 14.31 and the definition of the function p (see 
©), 



oo „t „T OO „t 

Y^XjP, / p(a)|s,(T-a)|2dadT<^A,M, / p(0)G 
. ^ Jo Jo .^^ Jo 



By the above estimates and condition |3] in Hypothesis [531 we conclude that, for 
any 9 € (0, 1) such that 1 + 6* > J, 

/V"^QIIl/sdr<Cr, 
Jo 

where Ct ■= CeTi-V(0)Tr[Q(-A)(i+«)/'5-i]. □ 
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5 Existence and uniqueness 



In this section we aim to prove existence and uniqueness of the solution for the 
uncontroUed equation 

/"OO 

dtv{t,x) — koAv{t,x) + / ki{s)Av{t ~ s, x)ds 
Jo 

+ f{v{t,x)) + ^dtW{t,x), t>0 (29) 

v{s,x) = vo{s,x), s < 0, 
v{t,x) =0, t>0, x£dO. 

where the coefficients fco , fci , /, Q satisfy the assumptions made in Section [51 

Recalhng what has been showed in the previuos section, the above equation 
as an abstract equation on the space := L^{0) x Lp(M+; iJp (0)) 

jdX{t) ^ AX{t)dt + F{X{t))dt + y/QdW{t) t>0, 
lX(0)=Xo. 

We recah that, from Proposition IS .41 A is the generator of a Co-semigroup, while 
from the assumption on the function / we get that F : J{ !K is Lipschitz 
continuous. Moreover, Q is a linear operator on 5£ involving the covariance op- 
erator Q, Xq = {vo{0, •), {vo{—s,x))s>oY and the stochastic convolution WA{t) 
introduced in (|27l) is a well-defined gaussian process (see Lemma [4. 4|) . 

Existence and uniqueness of mild solution for the abstract evolution equation 
(pO|) is a classical result within the theory of stochastic equation in infinite 
dimension. The proof follows from a fixed point argument and can be found in 
[nj Theorem 7.2] 

Theorem 5.1. For arbitrary T > 0, and any Xq € ^ there exists a unique mild 
solution {X{t))t>o of equation (|30p which belongs to the space LP{Q]C{[0;T]]^)) 
for any p > 1. 

An immediate consequence of the above result is that also the original 
stochastic Voltcrra equation (|29p admits a unique mild solution. The defini- 
tion of mild solution involves the resolvent family introduced in Section [4.1l and 
reads as follows 

Definition 5.2. A L'^(0)-valued process (f (i))t>o is a mild solution of the 
stochastic Volterra equation of if w e L"^ {0 , T ; {Q; L"^ (0))) and satisfies 

vit)^Sit)voiO)+ f S{t-s)f{s,vis))ds 

[ S{t~s) [ k{s + r)Avoi-r)dr+ [ S (t - s) ^/QdW (s) 
Jo Jr+ Jq 

Theorem 5.3. For arbitrary T > and any vq E Lp(M+; Hq{0)) there exists a 
unique mild solution v — v{t), t > of equation (|29l) which belongs to the space 
C:r([0,r];L2(o)). 
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Proof. The proof follows directly from Theorem 15. II In fact, the mild solution 
of (|29l) is represented by the first component of the process {X{t))t>o. 

□ 



6 Synthesis of the optimal control 

In this section we proceed with the study of the optimal control problem asso- 
ciated with the stochastic Volterra equation 



dtv{t, x) — koAv{t, x) + I ki{t — s)Av{s,x)ds 

' (31) 



+ fit, vit, x)) + VQir{t, v{t, x), 7(i, x)) + dtW{t, x)), 

in the bounded domain C K.'', with Dirichlet boundary condition v{t, x) = 
0,i G [0,T],x G do and initial condition v{t,x) — Vo{t,x),t < 0,x £ 0. Here 
/ is the nonlinear function introduced in Hypothesis 12.41 and 7 = jlLu^t^x) is 
the control variable, which is assumed to be a predictable real-valued process 
iFt-adapted. The optimal control that we wish to treat consists in minimizing 
over all admissible controls a cost functional of the form 



J(z;o,7):-]E / / ^(i, 0, 7(i, 0)de dt + E / 0(«(T,O)de, 
Jo Jo Jo 

where i and (f> are given real- valued functions. 

We will work under the following general assumptions. Concerning the func- 
tion r, £, we require: 

Hypothesis 6.1. 

1. r : [0,T]xRxR^R ande : [0,T]xRxR ^ R are measurable functions 
and there exists m G N such that for a.e. t £ [0, T] and for 9i,92,y in R, 

\r{t, XI, y)- r{t, X2,y)\ + m, Oi,y) - e{t, 02, 2/)| 

<cii + \9,\ + \e2\r\ei-e2l 

\r{t,0,,y)\ + \i{t,O,y)\<C. 

2. (f) e (R) and there exist L > and fc G N such that for every 9 £R 

\c^'ie)\<Lii + \e\f. 

In order to characterize the optimal control through a feedback law, we 
impose the following additional condition on the nonlinear term /: 

Hypothesis 6.2. The function f : [0,T] x R — > M is measurable, for every 
t G [0,T] the function f{t, •) : R — > M is continuously dijjerentiable and there 
exists a constant Cf such that 



<Cf, tG[0,T], 



20 



To handle the control problem, we first restate equation ([31]) in an evolution 
setting and we provide the synthesis of the optimal control by using the forward- 
backward system approach. 

Arguing as in Section |31 given a control process 7 and any i S [0,r], € 
L^(R+; i/p (0)) we rewrite the problem (PT|) in the following abstract form 

jdX{t) = AX(t)dt + F{t, X{t))dt + VmR(t, X{t),j{t))dt + dWit)) 
\X{0)=Xo, ^''^ 

where Xq — {vo{0),vo{-)) and R : [0, T] x Jf x X Uf is the mapping defined 

by 



In this setting the cost functional will depend on Xq and 7 and is given by 

I{Xo,j)=e[ L{t,X{t),-f{t))dt + E[<i>{X{T))] (33) 







where L : [0, T] x M x X ^ M is given by 



for any t > 0, (^ G 5{, 7 G J{ and $ : ^ M is defined as 

There are different ways to give a precise meaning to the above problem; one of 
them is the so called weak formulation and will be specified below. 

In the weak formulation the class of admissible control systems (a.c.s.) is 
given by the set U := (O, J, ( Jt)t>o, P, 1^, 7), where (f2,J,P) is a complete 
probability space; the filtration (3^t)t>o verifies the usual conditions, the process 
W is a Wiener process with respect to the filtration {J't)t > 0) and the control 
7 is an 3^t-predictable process taking value in some subset IX of X with respect 
to the filtration (5't)t>o)- 

With an abuse of notation, for given Xq G D{, we associate to every a.c.s. 
a cost functional JJ(a;,U) given by the right side of (|33| . Altough formally the 
same, it is important to note that now the cost is a functional of the a.c.s. and 
not a functional of 7 alone. Any a.c.s. which minimizes I{x, •), if it exists, is 
called optimal for the control problem starting from Xq at time t in the weak 
formulation. The minimal value of the cost is then called the optimal cost. 
Finally we introduce the value function V : [0,T] x J{ — > R of the problem as: 

y(Xo) = inf J(Xo,7), XoeJ{, 
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where the infimum is taken over all a.c.s. U. 

At this moment it is convenient to list the relevant properties of the ob- 
jects introduced so far in this section. Therefore we formulate the following 
proposition. 

Proposition 6.3. Under Hypothesis \2.1\2.4\ \6.2\ \2.5\ and \6.1\ the following 
properties hold: 

1. The functions R and L are Borel measurable and there exist constants C , 
m,k £ N such that for any i > 0, Xi, X2 € 'K and 7 G U 

\R{t, Xi, 7) - R{t, X2, 7)| + |i(i, ^1,7)- L{t. ^2, 7)1 

<C{l + \X^\ + \X2\r\Xi-X2l 
|i?(i,Xi,7)| + |L(i,0,7)|<C. 

2. $ is Gateaux differ entiahle and there exist C$ > and fc G N such that 
for every Xi.X^ £ 'K 

|$(Xi)-$(X2)|<C$|Xi-X2| 

5. F : [0, r] X J{ — > 5{ is a measurable function and there exists a constant 
Cp such that 

|F(i,0)| <Cf, \¥{t,Xi) ~¥{t,X2)\ < Cy\Xi ~ X2\, 

for every t G [0, T], X, Xi, X2 G "K. Moreover, for every t G [0, T], F(t, •) 
has a Gateaux derivative VF(t, X) at every point X £ 'K. Finally, the 
function {X,H) i-> VF{t, X)[H] is continuous as a map x — > R. 



Optimal control problems associated with equation (j32p and the cost func- 
tional ([55)1 when the coefficients has the properties listed in Proposition 16. 31 has 
been exhaustively studied by Fuhrman and Tessitore in [12) , compare Theorem 
7. Within their approach the existence of an optimal control is related to the 
existence of the solution of a suitable forward backward system (FBSDE) that 
is a system in which the coefficients of the backward equation depend on the 
solution of the forward equation. Moreover, the optimal control can be selected 
using a feedback law given in terms of the solution to the corresponding FBSDE. 

We introduce the haniiltonian function -0 : [0, T] x J{ x J{ J{ setting 

ip{t, X, Z) = inf {L{t, X, 7) + (Z, R{t, X, 7))} , te[Q,T], X e-K, Z e 
7GU 

and we define the following set 

T{t, X, Z) = {7 G It : L{t, X, 7) + (Z, R(t, X, 7)) - X, Z)} , 

i G [0,T], X G J{, Z G J{. 

For further use we require some additional properties of the function ip: 
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Hypothesis 6.4. 

1. For all t G [0,T], for all X,Z £ there exists a unique V{t,X,Z) that 
realizes the minimum in (1341) . Namely: 

il}{t, X, Z) = L{t, X, r{t, X, Z)) + {Z, r{t, X, r{t, X, Z)) 

with r e C([0,T] X J{ X Jf;l[). 

2. For almost every s G [0,T] the map ^p{s,■,■) is Gateaux differ entiahle 
on'Kx'K and the maps (X, H, Z) ^ Vxtpis, X, Z)[H] and {X, Z, K) ^ 
VV'(s, X^ Z) [K] are continuous on'Ky.'Jix'K and J£ x IH x 3-C respectively. 

Remark 6.5. It is easy to prove that combining the previous assumption with 
Proposition 16.31 we can deduce the foUowing properties of tp: 



1. -0 is a measurable mapping and there exists a constant C such that 

|0(i,Xi,Z) - 0(t,X2,Z)| < C{1 + + \X2\)\X2 - Xi\ 
for aU Xi, ^2, Z G ?{ and t G [0, T]. 

2. Setting Cu '■— sup{|7| : 7 G 11} we have 

\i>{s,X,Zi)-^{s,X,Z2)\<Cu\Zi- Z2I 

for every s G [0, T], X, Zi, Z2 G 'K. 
Finahy sup.gfo^j.] |V'(s,0,0)| < C. 

Now, let us consider an arbitrary set-up ($7, If, P, W) and 



X{t) = e 



Xq+ [ e(*-'^)^F(a,l,)da+ /" pJ*-") yQdW(a), iG[0,r], 
Jo Jo 

(35) 

where W{t) = {W{t), 0)*. By Theorem [ET] stated in Section^ equation [55] is 
well-posed and the solution {X{t))t>o : is a continuous process in IK, adapted 
to the filtration (Ift)t>o- Moreover, the law of (W,X) is uniquely determined 
by Xo, A, F and \/Q- We define the process 



W"(t)=W(i)- f Ris,Xis), 
Jo 



7(s))ds, tG[0,T], 



and we note that, since R is bounded, by the Girsanov theorem there exists a 
probability measure P on (51, IF) such that W*^ is a Wiener process under P. 
Rewriting equation (|35|) in terms of W*^ we get that X solves the controlled 
state equation (in weak sense) 

X{t)=Xo+ f e(*-")^F(f7,X,)da+ 

° t (36) 

[ e(*-'")^yQdW"(a)+ / e(*-")^i?(s,X(s),7(s))ds. 
Jo Jo 
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Next we consider the backward stochastic differential equation 
Y{t)+J^ ZdW{a) = <i>{X{T))+ iP{a,Xia),Z{a))da, te [0,T], (37) 

where ip is the hamiltonian function and $ is the function defining the final cost. 
Under our assumptions , we can apply [TH Proposition 3.2 and Theorem 4.8] 
and state that there exists a solution {X,Y, Z) of the forward-backward system 
P5p - p7p on the interval [0, T], where Y is unique up to indistinguishability and 
Z is unique up to modification. Moreover from the proof of Theorem 4.8 [T2] 
it follows that the law of {Y, Z) is uniquely determined by the law of (W, X) 
and by $ and 4". We note that being measurable with respect to the 

degenerate cr-algebra Jq, is deterministic; in particular Y{t) = E(y(i)) only 
depends on the law of F, and thus it is a functional of Xq, A, F, a/Qi ^ ■ To 
stress dependence on the initial datum Xq, wc will denote the solution of (|35p 
and m by (i), f ^« (t), W), ^ e [0,r]}. 

We recall from [9, Theorem 6.2] that, Proposition 16.31 and Hypothesis 16.41 
imply existence and uniqueness of a (mild) solution u e C°'^([0,T] x 'K\'R) of 
the Hamilton Jacobi Bellman equation corresponding with our control problem: 

r §-^u{t,X) + LMt,-)]{X) 

I =^{t,X,u{t,X),Vu{t,X)y^), te[0,T],X e:K, (38) 

[u{T,X)^^iX). 

Here L is the is the infinitesimal generator of the Markov semigroup correspond- 
ing to the process X: 

Lt[h]{X) = ^Tr{\/^h{X)Cl) + {AX + F{t,X),\/h{X)). 

Moreover, P-a.s. for a.e. t e [0,r], we have 

y^«(t) - u{t,x''"{t)), z''"{t) = V7.(i,l^"(i))yQ- 

The relevance of the solution of the Hamilton- Jacobi-Bellman equation to our 
control problem is explained in the following proposition. 

Proposition 6.6. Assume that Hvpotheses \2.1\2.4\ \6.2\ \2.5\ \6.1\ and \6.4\ hold. 
For every t e [0,T] and Xq G "K, and Jar every a.c.s. U we have m(0,Xo) < 
J(Xo,U) and equality holds if and only if the following feedback law is verified, 
P-a.s. for almost every t G [0,r]; 

7(t) -^(^,l(^),Vli(^,x(^))^/Q). (39) 

Finally, there exists at least an a.c.s. U verifying (|39p . In such a system, the 
closed loop equation admits a solution 

'dX{t) = AX{t)dt + F{t, X{t))dt+ 

VQ(i?(i,X(i),r(t,X(t),Vw(i,l(i))VQ)dt + dW(i)) , te[s,T] 
X{s) e JC, 

(40) 
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and if "f(t) = T(t, X{t),\/u{t, X{t))y/Q) then the couple (7,^) is optimal for 
the control problem. 

Proof. The result follows immediately from the paper of Fuhrman and Tessitore 
[H Theorem 7.2]. ^ □ 
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